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1 Introduction 



The goal of this paper is to estimate the main parameter of some processes obtained from 
iterations of Mannevihe-Pomeau maps. 

We consider a class of stochastic processes {Xt}t£n, where Xf = (ip o r|)(Xo) is obtained 
from the iterations of the transformation Tg, invariant for an ergodic probability fj,s on [0, 1] and 
a continuous by part function (p : [0, 1] — ^ M. The transformation : [0, 1] [0, 1] is considered 
here as the Mannevillc-Pomeau map. We analyze the rate of decay of the autocorrelation func- 
tion for the resulting process. The rate of convergence decays hyperbolically (or polynomially) 
not exponentially. We obtain efficient methods to estimate the parameter s from a finite time 
series. As a consequence, we also estimate the rate of convergence of the autocorrelation decay 
of these processes. 

Indeed, given s the decay is known: Young (1999) has shown that the autocorrelation decay 
of the Manneville-Pomeau processes has order smaller than n^~3, for < s < 0.5. Other 
models which have similar properties to the Manneville-Pomeau map are the linear by part 
approximation of the same map (see Fisher and Lopes, 2001 and Wang, 1989) and the Markov 
Chain with infinite symbols, described in Lopes (1993). 

Models of different phenomena in nature present autocorrelation decay of the form n~^, also 
called hyperbolic (or polynomial) : the use of the Markov Chain model seems to be appropriated 
for the analysis of DNA sequences (see Peng et al., 1992 and 1996 and Guharay ct al., 2000); 
cardiac rhythm fluctuations (see Absil et al., 1999 and Peng ct al., 1996); turbulence (see 
Schuster, 1984) and economy (see Mandelbrot, 1997; Lopes et al., 2004 and Lopes, 2007). In 
most of the cases the exact rate of convergence of the autocorrelation function decay is a relevant 
information in the model. Here wc arc interested in to compare different methods for estimating 
such P in the case of the Manneville-Pomeau processes. 

When 0.5 < s < 1.0 we have the long range dependence regime. Fractionally integrated 
autoregressive moving average (ARFIMA) models also present such behavior (see Beran, 1994; 
Geweke and Porter-Hudak, 1983; Reisen and Lopes, 1999 and Lopes et al., 2004). The corre- 
sponding parameter for the ARFIMA model is d = l~ The ARFIMA process has an explicit 
formula for the spectral density function fx{-) (see Reisen et al., 2001; Lopes et al., 2002 and 
Olbermann et al., 2006) but this is not the case for the processes considered here. 

When < s < 0.5 we have the not so long dependence regime. The so-called intermediate 
dependence regime happens when s G (^, ^). 

Recently several interesting papers appear describing the statistics of time series obtained 
from dynamical systems: Chazottes (1998), Chazottes (2005), Collet et al. (1995), Collet et al. 
(2004) and Collet (2005). We also refer the reader to the last sections of the book by Collet 
and Eckmann (2006). 

Here we analyze and compare several estimation procedures based on the periodogram func- 
tion, on the smoothed periodogram function, on the variance of the partial sum and on wavelet 
theory. 

The paper is organized as follows. In Section 2 we define the Manneville-Pomeau maps 
giving some definitions, basic properties and results. Section 3 presents the Manneville-Pomeau 
processes that will be the setting of the estimation procedures we choose in this work. In 
Section 4 we consider the estimation procedures for the long dependence case while in Section 
6 wc present the Monte Carlo simulation study for this regime. In Section 5 we consider the 
estimation procedures for the not so long dependence case whlie in Section 7 we present the 
Monte Carlo simulation study for this other regime. Section 8 contains a summary of the paper. 
In Appendix A we consider some general properties of the Fourier series which are necessary in 



the paper. Appendix B contains the theoretical reasoning for some of the estimation procedures 
proposed in Section 4 of the paper. 



2 Manneville-Pomeau Maps 

In this section we present the Manneville-Pomeau maps, some definitions, basic properties and 
results. 

We first define the Manneville-Pomeau transformation and we give some of its properties. 
Definition 2.1: Let Tg : [0, 1] [0, 1] be the Manneville-Pomeau map given by 

Ux)=x + x'+^ (modl) = | 

where s is a positive constant. 

As usual, we shall use the following notation 

Tj = r,o- - -or, . 

t— times 

The map Tg (see Figure 2.1 (a)), given by the expression (|2.ip has the following properties: 

• is a piecewise monotone function with two full branches, that is, there exists p E N — {0} 
such that T's|(o,p) and Ts|(pi) are strictly monotone, continuous and Ts{{0,p)) = (0,1) = 
Ts{{p, 1)), where p + p^~^^ = 1. 

• The branches T's|(o,p) and rs|(p i) are C^. 

• r^'(x) > 1, for all x>0, and T'^{x) > A > 1, for x G {p, 1). 

• Tg has a unique indifferent fixed point 0. Therefore, Ts(0) = and |r^(0)| = 1. 

• There exists an invariant absolutely continuous ergodic measure fig for the Manneville- 
Pomeau transformation T^. Thaler (1980), using the properties of the Manneville-Pomeau 
map, shows that dns{x) = hs{x) dx, where hs{x) x~^, for x G (0, 1), close to 0. 
When s > 1, the measure has infinite mass and it is not a probability. 

When < s < 1, the probability fis is mixing for : [0, 1] [0, 1] (see Young, 1999; and 
Fisher and Lopes, 2001). 

Given a continuous by part function ip : [0, 1] M, one can consider the random variables 

= ° Ts){Xq), for t € N, where Xq is distributed according to the probability fig. The 
stationary stochastic process {Xj is called the Manneville-Pomeau process. We will consider 
here (p as an indicator function of an interval in [0, 1]. In this case, the time series obtained 
from the process {Xfl^g^ will be a binary time series of O's and I's only. 

It is known that the autocorrelation decay of the Manneville-Pomeau processes, given by 
the expression (|3.ip . has order smaller than n^~s, for < s < 0.5 (see Young, 1999). In Fisher 
and Lopes (2001) it is shown, for the linear by part model given by Definition 2.2 below, that 
these bounds are exact (for the corresponding values). 

We refer the reader to Maes et al. (1999) for more details on the dynamics of the system 
given by ()2.ip . 



X -\- X 

X + X 



1+s 
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(2.11 



Other models which have similar properties to the Manneville-Pomeau map are the linear by 
part approximation of the same map (see Definition 2.2 below and Fisher and Lopes, 2001 and 
Wang, 1989) and the Markov Chain with infinite symbols (see Definition 2.3 below) described 

in Lopes (1993). The use of the Markov Chain model {l^j^gN) defined below, seems to be 
appropriated for the analysis of DNA sequences (see Peng et al., 1992 and 1996). The same 
estimation methods, proposed for the Manneville-Pomeau processes in Section 4, can be also 
applied to these other models. 

Definition 2.2: Let (^(7) = J2n>i ''^^'^ ^® Riemann zeta function. Consider the partition 
in intervals of [0, 1] given by 

for k > 1. For 7 > 2, we define the following linear by part transformation : [0, 1] [0, 1] 
such that over the interval M^, for k > 1, Tj has slope ((A; + l)k~^)'' and over the interval Mq 
it has slope C(7)- We assume that the branches 

\ ' <(-()) 

are continuous; under these assumptions the transformation is uniquely defined (sec Figure 
2.1 (b)). The transformation Tj is called the linear by part approximation of the Manneville- 
Pomeau map. 

In the same way as before, giving a continuous by part function defined by ip : [0, 1] — > M, one 
can consider the random variables Xt = ((^or^)(Xo), for t G N, where Xq is distributed according 
to a certain probability jU-y, invariant for T-y. The probability /jj is absolutely continuous with 
respect to the Lebesgue measure. We call {Xtjtgi^ the linear by part approximation of the 
Manneville-Pomeau process. 

Each value of s for the Manneville-Pomeau map corresponds to a value 7 = 1 + ^ with the 
same behavior with respect to the autocorrelation decay. 



The Manneville-Pomeau map has the advantage of been more suitable than the linear by 
part model for computer implementation when one is interested on Monte Carlo simulations. 
For this reason, in the simulation sections we will concentrate our analysis in such model. 

Below we define a Markov process with state N based on a certain transition probability 
matrix P. The time evolution of such process will also have similarities with the iteration of 
Manneville-Pomeau map. 

Definition 2.3: Let P be a Markov chain with infinite transition probability matrix P=(P(f, j))jjet^ 
(see page 153 in Lopes, 1993; Wang, 1989 and Feller, 1949) with transition probabilities given 
by 

P(n, n - 1) = 1, for all n G N - {0}, 
P(n,j)=0, forjVn-1, 

and 

P(0 n) = ("+^)"" 
^' ^ C(7) ' 

where ("(7) is the Riemann zeta function and 7 > 2. There exists an explicit formula for the 
eigenvector ttq associated to the eigenvalue 1 (see page 154 in Lopes, 1993). 
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Let be the stationary stochastic Markov process obtained from the transition matrix 

P above and from the initial stationary distribution ttq. Let Iq be the indicator function of the 
set A = {0} on N. Let now {ItjteN be the process 1 — Io{Zt). In this way, we identify paths 
w G with paths tD G {0, 1}^. Then, {Yt}teN is a stochastic process with random variables 
assuming only the values and 1. For the process {YiltgN consider the probability induced by 
the process {Zt}tQ^ by means of the identification of the paths. 

To clarify the ideas in the above Definition 2.3, the following example shows the identification 
paths in to paths in {0, 1}^. 

Example 2.1: Let {Zt}t^^ be the process where a sample path w G N^, for instance, w = 
{0765432109876543210543210 • • • }, is associated to another sample path of the process {YtlteN- 
The corresponding sample path for the process {ItjteN is given by 

w = {011111110 111111111 0111110 • • • }. 

7 9 5 

Hence, we applied the change of coordinates Zt — > 1* associating sequences of natural numbers 
to blocks of 1 intercalated by 0, in such a way that the structure of the process is kept the same. 

Wc say that two different stochastic processes arc equivalent when there is a bijectivc change 
of coordinates acting in the set of paths transferring the probability of one process into the 
other. 

The process {Zt}t^fq is, by definition, equivalent to the process {ItjtgN by the above change 
of coordinates. One can also show that Yt is also equivalent to Xf = (cp o T^)[Xo) (see Section 
4 in Lopes, 1993 with if = Imq)- 

It is also known that the central limit theorem (converging to a Gaussian distribution) is true 
for the Manneville-Pomeau stochastic process {Xtjtgpj, described in Section 3, when < s < 0.5 
due to the rate of convergence of the autocorrelation decay (see Young, 1999; Lopes, 1993 and 
pages 1099-1100 in Fisher and Lopes, 2001). 

When 0.5 < s < 1.0 it was conjectured that for the Manneville-Pomeau stochastic process 
{Xt}tgpj the central limit theorem is true, but it converges to a stable law with parameter a = 
s~^. This was proved by Gouezel (2003). Prom Feller (1949) it is known for the corresponding 
parameter of the Markov Chain model described above (or for the equivalent process Xt = 
{if o T^)(Xq) with If = Imq (see Wang, 1989 or Section 4 in Lopes, 1993, for more details)). 

For the estimation in the long range dependence case, one has to consider larger sample sizes 
for the time series. In this situation, in general, the computation effort for obtaining good results 
is very high. This is something that one can not avoid due to the small rate of convergence 
of the decay. The mixing rate is not so good as it happens, for instance, when one considers 
models with exponential autocorrelation decay. We present here several quite efficient methods 
to obtain reasonable results. One method is by using the periodogram function described in 
Sections 4 and 6. The method based on wavelet works fine in several cases and surprisingly can 
also be applied to estimate s when s > 1.0 (see Sections 4 and 6). 

In a forthcoming paper by A.S Pinheiro and S.R.C. Lopes will be presented a bias correction 
for the wavelet estimation in long and not so long dependence cases. 

3 Manneville-Pomeau Process and Some of its Properties 

In this section we define the Manneville-Pomeau stochastic processes and present some of their 
properties. 



Let (/9 : [0, 1] — > M be a /x^-integrable function and Ts{-) the Manneville-Pomeau transforma- 
tion given by the expression (j2.ip . The Manneville-Pomeau stochastic process {Xt}t(^n is given 
by 

Xt = (<^ori)(Xo) = ^(ri(Xo)) = <^(r,(Xi_i)) = ((^oT,)(Xi_i), (3.1) 

for all t G N, where Xq is distributed according to the measure ^s- In other words, the 
Manneville-Pomeau process {XtjtgN is obtained applying ip to the iterations of Tg, that is, 
Xt = ipo T*, for s fixed and t e N. 

We shall consider here only the case where ip is the indicator function of an interval A 
contained in [0, 1] or else f = Ia — fJ.s{A). Our simulations, shown in Sections 5 and 7, will be 
done for the case where A = [0.1,0.9]. 

We shall denote by 7x(0 the autocovariance function for the process {Xtj^gN, that is, 

jx{h) = E^iXhXo) - [E^(Xo)]2 = J ^{T\x)Mx)dfis{x) - [ J ip{x)dfis{x)f , (3.2) 
for /i G N. 

We denote by pxi') the autocorrelation function of the process {XjjtgN) that is, 

Px{h) = ^^^, forall/iGN, 

where 7x (0) = E^(Xq) — [E^(Xo)]^ = Var^{Xo) is the variance of the process. 
The spectral density function of the process {Xtj^gN is given by 

1 °° 

fxiio) = —bx{0) +2Y,^x{h)cos{Luh)], forc^G [-vr,^]. (3.3) 

h=l 

Now we shall define the periodogram function associated to a time series Tj(xo), for 1 < 
t < N, obtained from a xq chosen with probability one according to the measure /is. The 
periodogram function is given by 



I{i^h) = fN{uJh)fN{uJh), (3.4) 

where 

1 ^ 

Moo) = -^^c^(ri(xo))e— *, u; E (0,27r], 



with /Ar(-) indicating the complex conjugate of /Ar(-) and 

w/, = ^, for/i = 0,l,--- ,iV, (3.5) 

the h-th discrete Fourier frequency (see Brockwell and Davis, 1991). 

Note that the periodogram function depends on xq and (large). One can obtain a good 
approximation of the spectral density function /x(') by the periodogram function (see Lopes 
and Lopes, 2002 for a mathematical proof that can be applied to the case we analyze here when 
< s < 0.5). 



The periodogram function is an unbiased estimator for the spectral density function /x(')> 
even though it is not consistent (see Brockwell and Davis, 1991). 

Another procedure for estimating the parameters which produces good results is by using 
the wavelet theory. This type of analysis can be also used in the regime s > 1 where the spectral 
density function, defined in the expression (j3.4p . does not exist since the random process is not 
associated to a probability. 

We shall use the following notation: 

• If, for the sequence {a„}nGN, there exists n G M and, for any 6 > 0, there exist positive 
constants ci and C2 such that, for all n G N, 

ci n S I On I S C2 n. , 

then we denote a„ ~ n~". We also say that a„ is of order n""", for n — > cx). 

• If, for the real function g{-), there exist 6 G M and e > such that, for any 5 > 0, there 
exist positive constants di and d2 such that, for all x G (0, e), 

dix^+^ < \g{x)\ < d2X^-\ 

then, we denote g{x) ~ x^ . We also say that g is of order x^ around 0. 

If there exist ci , C2 > such that 

ci n'" < |a„| < C2 n""", 

then, of course, a„ n""". 

If there exist di , (i2 > such that 

dix^ < \g{x)\ < (i2X^ 

then, of course, g{x) ~ x^. We need however, this more general definition because of Theorem 
A. 4 in the Appendix A of the present work. 

Definition 3.1: Let {XfjtgN be a stochastic stationary process with autocovariance function 
7x(-) given by the expression (|3.2p . If there exists u G (0, 1) such that 

lx{h) « h~\ (3.6) 

then we say that {XjjfgN is a stochastic process with long dependence. 

Definition 3.2: Let {XfjtgN be a stochastic stationary process with autocovariance function 
7x(") given by the expression (j3.2p . If there exists u > 1 such that 

-fx{h)^h-\ (3.7) 

then we say that is a stochastic process with not so long dependence. 

For the Manneville-Pomeau process it is known that 

lx{h)^h^-^, (3.8) 
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(see Young, 1999 for the upper bound and Fisher and Lopes, 2001 for the lower bound). 



When 0.5 < s < 1 the Mannevihe-Pomeau process, given by the expression ()3.ip . has the 
long dependence property and when < s < 0.5 it has the not so long dependence property. 
We shall consider here different methods for estimating the value s in both cases. 

In the long dependence regime there exists a relationship between the velocity of the au- 
tocorrelation function decay to zero and the regularity of the function fx{-)- This property 
follows just from a careful analysis of Fourier series. We refer the reader to Chapter X, Section 
3 in Bary (1964), pages 1086-1090 in Fisher and Lopes (2001) and also the Appendix A of the 
present work for a careful description of this relationship. This follows basically from the fact 
that if /x(A) ~ A~^, with b > 0, then jx{h) ~ h^~^. In the case when the coefficients ^x{h) 
are monotone decreasing in /i, then fx{^) ~ ^ if lx{h) ~ h^~^ , for 6 > 0. Fisher and Lopes 
(2001) show that the autocovariance function ")x{h) is a monotone function for the linear by 
part approximation of the Manneville-Pomeau map in the case of a certain ip. These authors 
also show that ^x{h) ~ h'^~'^ , when 2 < 7 < 3 (see page 1090). 

In the case of Manneville-Pomeau maps with long dependence, from the exact asymptotic 
given by the expression (j3.3p , one can obtain (by analogy with the linear by part model) the rate 
of convergence of the autocorrelation decay to zero from the asymptotic of fxW to infinity 
when A — > and vice versa. It follows from the above considerations and from (|3.3p that 
/x(A)«Ai-2. 

The phenomena fx{^) ~ is known as j-noise property (in this case, -^-noise would be 
a more appropriate terminology), where / stands for a frequency (here denoted by w). 

Definition 3.3: The continuous function g : {—it, tt) — > M is said to be Holder of order a, 
< a < 1, if there exists a positive constant K such that 

\9{x)-9{y)\ <K\x-y\'', 
for any x,y £ (— 7r,7r). We also call a the exponent of g. 

Definition 3.4: The continuous function g : (— tt, tt) — > M is said to be exactly a-Holder in the 
point xq, for < a < 1, if for any (5 > 0, there exist positive constants ci and C2 such that 

ci |x - yr+^ < \g{x) - g{y)\ < C2 |x - yP'^ 

for any y G (— 7r,7r). We also call a the exact exponent of g at xq. 
We will apply this definition for the case xq = 0. 

When one considers the Manneville-Pomeau maps with not so long dependence, one can say 
more about the regularity of fx{') (see Chapter II, Section 3 and Chapter X, Section 9 in Bary, 
1964 and Appendix A of this present work): it is exactly /^-Holder continuous function with 
exponent /3 = 7 — 2. We are using here the notation: a /3-Holder function, with (3 = n + a, 
< a < 1, is a function such that it is n times differentiable and the n-th derivative is a-Holder. 

The periodogram function /(•) is a useful way to obtain an approximation of fxi') (see 
Lopes and Lopes, 2002). One can obtain an estimation of s from the above considerations and 
from the periodogram function as we will explain in the next section. 



s 



4 Estimation in the "Long Dependence" Case 

The main goal of this section is to estimate the transformation T^, or equivalently, to estimate 
the parameter s, when 0.5 < s < 1. For this purpose, we consider a finite time series 
obtained from the process {Xtj^gN given by (j3.ip . 

By Monte Carlo simulation, that is given in Section 5, we compare some methods for esti- 
mating s with the one presented in Schuster (1984). We are interested in the performance of 
this method when compared to the others. 

The process {X^ltgN, defined by the expression ()3.ip . is considered here to be 

= o Ti = 1(0.1,0.9) o Ti, (4.1) 

which is stationary and ergodic (see Lopes and Lopes, 1998). 

For the long dependence case one can express the graph of /x(") (or of the periodogram 
function /(•)) in the logarithm scale, and this exhibits linear behavior. By ordinary least squares 
estimation one can obtain an estimate of the value s. 

We now explain more carefully this very useful method for the long dependence case : suppose 
there exists c such that fx{<^) ~ '^'^i for to close to zero. Then, for lo close to zero 

From the estimated value of c we estimate s since c = - — 2. An estimate of c can be obtained 

s 

via the periodogram by 

ln(w) ^ ' 

with u chosen very close to 0. 

We shall now consider six different methods for estimating the parameter s: the least squares 
method proposed in section 4.3 of Schuster (1984); the least squares method proposed here using 
the smoothed periodogram function when the Parzen or the "cosine bell" lag window are used to 
consistently estimate the spectral density function; the one based on the variance of the sample 
partial sums of the process; the one based on the logarithm of the variance of the sample mean 
of the process and the one based on the wavelet theory. These methods are described in this 
section and in Section 5 we present a Monte Carlo simulation study comparing them. 

Perio Estimator 

This method is based on the periodogram function of a time series {Xt}^^ and it is largely 
used by the physicists (see Schuster, 1984). 

The estimator of s is obtained from the least squares method based in a linear regression 
of yi,y2,-- - ,yg{N) on xi,X2,-- - ,Xgi^N), where yj = ln(/(Aj)), xj = ln{j) and g{N) = iV°-^. 
The /(•) is the periodogram function given by the expression (j3.4p and is the j-th Fourier 
frequency given by ()3.5p . Let c be the slope coefficient of the linear regression in the logarithm 
scale. The coefficient c allows the estimation of s through the equality 

1 



since, for s G (0, 1) we know that 
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fxi^) ~ w ^, for u; close to the zero frequency. 

Therefore, 

c=l -2<^ s = ^r^. (4.2) 
s c+2 ^ ^ 

We shall denote the estimator in ()4.2p by Perio. 



Parzen Estimator 



This method is also a regression estimator for the parameter s and is obtained by replacing 
the periodogram function /(•) in the Perio method by its smoothed version with the Parzen 
lag window (see Brockwell and Davis, 1991). It is known that the use of a spectral lag window 
consistently estimates the spectral density function (see Brockwell and Davis, 1991). This 
estimator has the same expression as in (j4.2p . but now yj = ln(/sm(<^j)), where fsm{ ) is the 
smoothed periodogram function. The value of g{N) is chosen as in the Perio method. The 
truncation point in the Parzen lag window is considered to be m = A^'^'^. 



Cos Estimator 



This method is similar to the Parzen estimator, where now one uses the "cosine bell" spectral 
lag window (see Brockwell and Davis, 1991). Its expression is given by (j4.2p . where now the 
smoothed periodogram function fsm{') is obtained from the "cosine bell" lag window. Again, 
by a linear regression we obtain the estimator of s. In this method we considered different 
limits for g{N) = N"'-: we used ai = 0.5 and 02 = 0.7 and we denote this estimator by Cos{i), 
i = 1,2. 

Remark 4.1: The methods Perio, Parzen and Cos, defined above, are similar to those pro- 
posed by Lopes et al. (2004) and Reisen et al. (2001) to estimate the differencing parameter 
in ARFIMA models. They are also similar to the estimators proposed by Lopes (2007) for 
the differencing d or the seasonal differencing D parameters in seasonal fractionally integrated 
ARIMA(p, d, q) x {P, D, Q)s process with period s. Again, we observe that there is no ex- 
act expression for the spectral density function fxi') in the case of the Manneville-Pomeau 
processes. 



Varmp Estimator 



This method, denoted by Varmp, is different from the other previous three. To explain this 
method, we consider a time series of sample size from the process (14. Ih and let be the 
random variable given by 
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Mat = total number of I's in the time series {Xt}^^Q^ = Xi = Sn. (4-3) 

One can show (see Lopes, 1993; Olbermann, 2002 or Wang, 1989) that 

Var{MN) ^ N'^"^ = N^-'s . (4.4) 
We present a proof of this fact in a quite large generality in Appendix B. 



in 



The property (j4.3p allows one to obtain another estimator for the parameter s. In fact, if 
one applies the logarithm to that expression one gets 



E(7V) 

Remark 4.2: As in the ARFIMA process (see Beran, 1994 and Olbermann, 2002) we observe 
that this estimator is also very much biased to estimate s in the Manneville-Pomeau processes. 

Vpmp Estimator 

This method is also based on the variance of the random variables M^. It is proposed by 
Beran (1994) under the name of variance plot. It is obtained from the order of the variance of 
Xn = ^ given by 

Var(Xjv) ~ 0{N^'^-^), (4.5) 

where d is the differencing parameter in ARFIMA models. 

For the Manneville-Pomeau processes we only need to consider the expression (|4.5|) . the 
relationship between the random variables M^r and Sn, given by (j4.4p and the relationship 
between the parameters s and d, given hy d = 1 — fj- We shall denote this estimator by Vpmp. 

Wrap Estimator 

This method is based on the wavelet estimator proposed by Jensen (1999) to estimate the 
differencing parameter d in ARFIMA models. To consider this a a method to estimate the 
parameter s in Manneville-Pomeau processes we must consider the relationship between the 
parameters s and d, given by d = 1 — ^ and the estimator proposed here, denoted by Wmp. 

We refer the reader to Percival and Walden (1993) and Lopes and Pinheiro (2007) for the 
use of wavelets in several different problems in statistics. 

A wavelet is any continuous function •i/^(t) that decays fast to zero when |t| — > oo and oscillates 
in such a way that /.^^ i^i^) dt = 0. The idea is to use diadic translations and dilations of the 
function such that they generate the whole £^(M). From this, the wavelets considered are 
of the form 

ipj^kit) = 22 1/^(2^' t-k), for j, kel, 

which constitute an orthonormal basis of £^(M) (see Percival and Walden, 1993). 

Here we consider only the wavelet bases Haar and Mexican hat, since these bases have easy 
analytic expressions given by 



V'i,fc(i) 

and 



22, ii2-'J k <t <2-^k + ^) 
-2-^ if 2-J' (fc + i) < t < 2-^' (A: + 1) 
0, otherwise 



fc(t) = 22 [1 - (2^' t - kf] exp[-(2^' t - kf/2l 
for j = 0, 1, • • • , m — 1 and = 0, 1, • • • ,2-^ — 1, where m & N is such that N = 2 
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Given a time series of the sample size N from the stochastic process (|4.ip we define the 
wavelet coefficients as the finite wavelet transform for this time series given by 



N-l 



k = 2-2Y.Xttl;{2H-k), 



t=o 

for j = 0,1, ■ ■ ■ ,m — 1 and k = 0,1, ■ ■ ■ ,2^—1, where m £ N is such that = 2*". 

To obtain the estimator proposed by Jensen (1999) we define the variance of the wavelet 
coefficients as 

Rij) = E[(a;,- for all j = 0, 1, • • • , m - 1. 

Considering the relationship between s and d given by d = 1 — the estimator based on 
the wavelets is given by 

^rn-l 2 



Wm-p — 



where xj is given by 

^ m— 1 

x,=ln(2-2^) 7El"(2-2i), 



i=4 

and R{j) is the sample variance of the wavelet coefficients defined by 

2^-1 

2J 



1 ^ 

RU) = X] ('^i''^)^' i = 4, 5, • • • ,m-l. 



k=0 



with m such that N = 2^. 

This method will be also considered for the Manneville-Pomeau processes when s > 1. This 
corresponds to the case when the invariant measure is not a probability measure (see Table 
7.1). 



5 Monte Carlo Simulation for the "Long Dependence" Case 

In this section we present the Monte Carlo simulation results comparing the six different esti- 
mation methods given in Section 4 for the long dependence case. 

Let {Xfjtgfsj be the Manneville-Pomeau process, given by the expression ()3.ip . where = 1a 
with A = (0.1, 0.9) such that = Ia o 

One chooses at random a value xq of the random variable Xq according to a uniform dis- 
tribution (this is the same as to choose xq at random according to the probability /i^)- Let 
{Xt}fSf^ be a time series with observations from the process {XfjtgN obtained from such xq- 
Hence, this time series is given by 

Xt = lA(Ti(xo))= 1(0.1,0.9) (7^i(^o)), for alH = 0,--- ,iV-l. (5.1) 
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The simulations presented here are based on such time series. 

Figures 5.1 (a) and (b) present the sample autocorrelation and the periodogram functions, 
respectively, for a time series with sample size = 10, 000 obtained from (jS.ip when s = 0.8. 

The following results were obtained from Monte Carlo simulations in Fortran routines and 
using the IMSL library. We remark that for the long dependence case one needs large number 
of sets of data requiring high computational time. 

Table 5.1: Estimation results when s € {0.60,0.65}. 





N 


Mpfh nH 

IVl C-Lr LLfLL 




sd(s) 


1 1 LjC 1 






Perio 


0.6545 


0.1394 


0.0223 






Parzen 


0.6313 


0.1125 


0.0136 




10,000 


Cos{l) 


0.5531 


0.0572 


0.0054 






Cos{2) 


0.5993 


0.0220 


0.0005 






Varmp 


0.5309 


0.0396 


0.0063 






Vpmp 


0.5598 


0.0718 


0.0067 






Perio 


0.6364 


0.1094 


0.0130 






Parzen 


0.6147 


0.0086 


0.0070 




20,000 


Cos(l) 


0.5488 


0.0535 


0.0054 


0.60 




Cos{2) 


0.5979 


0.0264 


0.0007 






Varmp 


0.5241 


0.0303 


0.0067 






Vpmp 


0.5513 


0.0583 


0.0057 






Perio 


0.6004 


0.1051 


0.0110 






Parzen 


0.5865 


0.0736 


0.0056 




30,000 


Cos(l) 


0.5275 


0.0508 


0.0078 






Cos{2) 


0.5933 


0.0316 


0.0010 






Varmp 


0.5204 


0.0264 


0.0070 






Vpmp 


0.5144 


0.0608 


0.0110 






Perio 


0.7539 


0.1518 


0.0337 






Parzen 


0.7107 


0.0107 


0.0151 




10,000 


Cos{l) 


0.6145 


0.0614 


0.0050 






Cos{2) 


0,6129 


0,0198 


0,0017 






Varmp 


0.5293 


0.0332 


0.0156 






Vpmp 


0.5461 


0.0763 


0.0166 






Perio 


0.7113 


0.0779 


0.0098 






Parzen 


0.6927 


0.0706 


0.0068 




20,000 


Cos{l) 


0.6035 


0.0472 


0.0044 


0.65 




Cos{2) 


0.6076 


0.0181 


0.0021 






Varmp 


0.5251 


0.0246 


0.0162 






Vpmp 


0.5257 


0.0630 


0.0194 






Perio 


0.6806 


0.0445 


0.0029 






Parzen 


0.6910 


0.0392 


0.0032 




30,000 


Cos{l) 


0.6141 


0.0552 


0.0043 






Cos{2) 


0.6090 


0.0147 


0.0019 






Varmp 


0.5419 


0.0262 


0.0123 






Vpmp 


0.5451 


0.0562 


0.0141 



For all tables presented here, we calculated the mean (mean), the standard deviation (sd) 
and the mean squared error (mse) values for all estimators of s. The smallest mean squared error 
is shown in boldfaced character in these tables. All simulations are based in 200 replications 
unless for Tables 5.3 and 5.4 where we use 50 replications. For the estimator Cos we used two 
different values for the limit g{N) = N"-"-: Cos(l) means ai = 0.5 and Cos{2) means a2 = 0.7. 

Table 5.1 presents the results for the six estimation methods proposed in Section 4 for the 
long dependence case for s G {0.60, 0.65} and for three different values of A^. 

From Table 5.1 we observe that the estimators Varmp and Vpmp are very much biased: 
this was also true for the ARFIMA process (see Olbermann, 2002). The best result, in terms of 
small mean squared error value is the estimator Cos(2) for both values of s and for any sample 
size considered. 



In Table 5.2 we present the results for the case when s = 0.80 considering only the sample 
size = 10, 000. The best results were for the methods Perio and Parzen since the other 
methods have higher bias. As s approaches to the value 1, the time series {Xt}t!^^^ given by 
()5.ip . stays long time in zero, resulting in very poor estimates. The methods Varmp and Vpmp 
are not recommended in this situation due to their higher bias. 



Table 5.2: Estimation Results when s = 0,80. 



N 


Method 


mecLTi{^s) 


sdis) 






Perio 


\}.( i (6 


U.iD4o 


U.Uz (0 




Parzen 


U. ( DU ( 


n ^ AAA 

0. 1444 




10,000 


Cos(l) 


0.6286 


0.2507 


0.0919 




Cos{2) 


0.6626 


0.0822 


0.0256 




Varmp 


0.5472 


0.0426 


0.0657 




Vpmp 


0.5781 


0.0806 


0.0557 




Perio 


0.6921 


0.1220 


0.0264 




Parzen 


0.6740 


0.1127 


0.2849 


20,000 


Cos{l) 


0.5731 


0.0699 


0.0563 




Cos{2) 


0.6434 


0.0437 


0.0264 




Varmp 


0.5292 


0.0434 


0.0752 




Vpmp 


0.5416 


0.0848 


0.0739 




Perio 


0.6559 


0.1164 


0.0342 




Parzen 


0.6150 


0.1044 


0.0456 


30,000 


Cos{l) 


0.5335 


0.1713 


0.1002 




Cos(2) 


0.6382 


0.0337 


0.0273 




Varmp 


0.5354 


0.0524 


0.0727 




Vpmp 


0.5434 


0.0861 


0.0732 



The simulations presented in Tables 5.3 and 5.4 are based on 50 replications. 

In Table 5.3 we present the results for the wavelet method. We only consider the bases 
Haar and Mexican hat. We remark that this estimator requires power of two for the sample 
size. This table presents the results when s G {0.65, 0.80} with three different values for N. We 
observe that the Mexican hat basis has advantages over the Haar basis presenting smaller bias 
and mean squared error values. 

After the analysis of the long dependence case we make a few comments about another 
regime, that is, when s > 1. 
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Table 5.3: Estimation results when s G {0.65,0.80}. 



s 


AT 


Wavelet Basis 


meani^s) 


SU[S ) 


mse[s) 




8,192 


Haar 


0.8531 


0.0470 


0.0434 






Mexican hat 


0.8022 


0.0480 


0.0254 




16,384 


Haar 


0.8311 


0.0446 


0.0347 


U.oo 




Mexican hat 


U. (ooZ 


U.U4 ( Z 






32,768 


Haar 


0.8283 


0.0619 


0.0355 






Mexican hat 


0.7864 


0.0451 


0.0206 




8,192 


Haar 


0.9839 


0.0619 


0.0376 






Mexican hat 


0.8873 


0.0670 


0.0120 




16,384 


Haar 


0.9321 


0.0659 


0.0217 


0.80 




Mexican hat 


0.8237 


0.0675 


0.0050 




32,768 


Haar 


0.8639 


0.0915 


0.0120 






Mexican hat 


0.7747 


0.0464 


0.0027 



In Table 5.4 we present the case where s > 1 meaning that the invariant measure fig does 
not correspond to a probability measure for the process {XtjtgN, given by ()3.ip . This table 
presents values of s G {1.0,1.1,1.2,1.3} and sample size = 32,768. The best results were 
for the Haar basis. Notice that when s > 1 any method based on the periodogram function 
does not make sense (for the process obtained from the iterations of the Manneville-Pomeau 
transformation Tg when xq is chosen at random). 

An interesting question to be investigated: is it true that for any deterministic (such 
as Manneville-Pomeau, Infinite Markov Chain, etc. . .) or purely stochastic process (such as 
ARFIMA, etc. . .) depending only on the decay of the rate of convergence of the autocorrelation 
function, there exists a better wavelet basis (such as Haar, Mexican hat, Shannon, etc. . .) to 
estimate the exponent of decay? 

Table 5.4: Estimation results when s > 1 with = 32, 768. 



s 


Wavelet Basis 


mean{s) 


sd{s) 


mse{s) 


1.0 


Haar 
Mexican hat 


0.9461 
0.8931 


0,1090 
0.1148 


0.0145 

0.0243 


1.1 


Haar 
Mexican hat 


1.0924 
0.9943 


0.0589 
0.0461 


0.0034 

0.0132 


1.2 


Haar 
Mexican hat 


1.0825 
0.9642 


0.0729 
0.0939 


0.0190 

0.0642 


1.3 


Haar 
Mexican hat 


1.1422 
1.0064 


0.0638 
0.0703 


0.0288 

0.0910 



6 Estimation in the "Not So Long Dependence" Case 

In the not so long dependence case one can estimate the value s using the exactly a-Holder 
property in the point xq = (see Bary, 1964 and Fisher and Lopes, 2001). Suppose 

^ ln(|/x(xo)-/x(j/)|) f . , , 

a — 71 TT , tor y G (— vr, vrl very close to zero, 

ln(|xo - y\) 

1 K 



where fx{') is the spectral density function, given in (j3.3p . of the process {X^jteN given in ()3.ip . 
We then define the estimator 



s = 



a + 2 



1 



where a 



ln(|/M-/(^,)|) 



(6.1) 



with /(•) the periodogram function, given by (j3.4p . with loq = and ujj is a Fourier frequency, 
given by (13. Sp . very close to zero. 

The main goal of this section is to describe two different estimation methods to estimate 
the transformation Tg, or equivalently, to estimate the parameter s, when s S (0, ^). For this 
purpose, we consider a finite time series {Xt}fj^^ obtained from the process {Xfj^gN given by 
(15. ip . The two methods are proposed by ()6.ip when the periodogram or its smoothed version 
by the Parzen lag window functions are used. 

These methods are described in this section and in Section 7 we present a Monte Carlo 
simulation study comparing them. 

P Estimator 

This estimation method is based on the expression (|6.ip above where /(•) is the periodogram 
function given by the expression (j3.4p . We denote it by P. 

SP Estimator 

This estimation method is based on the expression (j6.ip above where the periodogram func- 
tion /(•) is now replaced by the smoothed periodogram function fsm{') using the Parzen spectral 
window. We denote this estimator by SP. 

T Monte Carlo Simulation for the "Not So Long Dependence" Case 

In this section we present the Monte Carlo simulation results comparing the two methods given 
in Section 6 for the not so long dependence case. 

Let be the Manneville-Pomeau process, given by the expression (jS.ip . where if = Ia 

with A = (0.1, 0.9) such that = Ia o T^. 

One chooses at random a value xq of the random variable Xq according to a uniform dis- 
tribution (this is the same as to choose xq at random according to the probability /x^). Let 
{Xjj^Q^ be a time series with N observations obtained from ()5.ip . The simulations presented 
here are based on such time series and were obtained by Fortran routines with some help of the 
IMSL hbrary. 

In Table 7.1 we present some simulation results for the not so long dependence case based 
on the two methods reported in Section 6. We calculated the mean (mean), the standard 
deviation (sd) and the mean squared error [mse) values for each method. The smallest mean 
squared error is shown in boldfaced character in this table. These simulations are based in 200 
replications with s G {0.35, 0.40, 0.45} and two different sample sizes A^. Note that as we have 
a better mixing rate of convergence for the not so long dependence case the biases here are 
smaller than the case of long dependence. 



Table 7.1: Estimation results for s G {0.35,0.40,0.45}. 





iV 


Slalislics 


P 


SP 


0.35 


10,000 


mean{s) 
sd{s) 
mse{s) 


0.4078 
0.0374 
0.0047 


0.3970 
0.0255 
0.0028 




30,000 


mean{s) 
sd{s) 
mse{s) 


0.3870 
0.0298 
0.0022 


0.4136 
0.0208 

0.0044 


0.40 


10,000 


mean{s) 
sd{s) 
mse{s) 


0.4210 
0.0378 
0.0018 


0.4024 
0.0258 
0.0006 




30,000 


mean{s) 
sd{s) 
mse{s) 


0.4397 
0.0432 
0.0034 


0.4046 
0.0405 
0.0016 


0.45 


10,000 


mean{s) 
sd{s) 

■mse(s) 


0.4652 
0.0312 
0.0012 


0.4359 
0.0285 

0.0050 




30,000 


mean{s) 
sd{s) 
mse{s) 


0.5218 
0.0800 
0.0115 


0.4808 
0.0619 
0.0047 



8 Conclusions 

We analyzed the estimation of the parameter s in the Manneville-Pomeau processes in the long 
and not so long-range dependence cases. 

Wc considered several estimation methods for both situations and we compared them with 
the method called here Perio presented by Schuster (1984) and largely used by the physicists. 
We point out that from the analysis of the simulation studies in Tables 5.1 to 5.3 the wavelet 
method (Wmp) had a better performance than the Perio method. One can see this in the case 
when s = 0.8 where the estimator Wmp from the Mexican hat wavelet basis gave the best result 
in terms of small mean squared error. 

The methods Varmp and Vpmp presented the higher biases while the method Cos (2) had 
the best results for the cases when s G {0.60,0.65}, with the smallest mean squared error for 
the sample size analyzed. 

We analyzed the performance of the method Wmp based on the wavelet theory for the 
Manneville-Pomeau processes when s > 1, that corresponds to the situation where the invariant 
measure fig is not a probability measure. In this case, the best results were obtained when the 
Haar basis was considered. 

Among the estimation methods proposed for the not so long dependence case the one based 
on the smoothed periodogram function using the Parzen spectral window had the best results 
with lower bias and mean squared error values. The wavelet method Wmp also works fine in 
this case, but we do not present here simulation results for this case. 
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Appendix A 



Let {^t}t6N be the Manneville-Pomeau process defined in (j3.ip . Let px{') and fxi') be, re- 
spectively, the autocorrelation and the spectral density functions of this process. 

In this appendix we present some general properties of the Fourier series. In this way we 
will explain why the hyperbolic (or polynomial) decay of the autocorrelation function, that is, 

px{h) ^ /i"", for < ^ < 1, 

corresponds to 

/x(A)«A"-\ 

for the spectral density function of the process {A'^jteN given by (|3.ip . 
First we will explain the not so long dependence case. 

If the function g is n-times differentiable and is a-Holder with < a < 1, we say that 
5 is (n + a)-Holder. 

The relationship of the hyperbolic decay between the autocorrelation function of the Manneville- 
Pomeau process and its spectral density function is only a question related to Fourier series (see 
Bary, 1964). 

Theorem A.l: Suppose that bn ~ n~", for some u, and suppose also that g{6) = 'Yl'n=i ^" cos(n 9), 
where bn S IK, converges to zero. If a is positive and g{-) is a Holder function of order a, then 
there exists a positive constant c such that bn < cn~^^~^°'\ for all n £N — {0}. 

Theorem A. 2: Suppose that bn ~ n""", for some u, and suppose also that g{9) = Yl'n=i cos(n 9), 
where bn G M, decreases monotonously to zero. If a is positive and there exists a positive constant 
c such that bn < cn~^^~^°'\ then g{-) is a Holder function of order a. 

Theorems A.l e A. 2 (see Chapter II, Section 3 and Chapter X, Section 9, respectively, in 
Bary, 1964) apply to the not so long dependence case. 

Another interesting result on Fourier series, that can be applied now for the long dependence 
case, is described in the next theorem. 

Theorem A. 3 (Riesz): Suppose that g{9) = Yl^=i cos{n 9) , for all 9 £ (— 7r,7r) and that 
6„ € M is such that the sequence {6n}nGN decreases monotonously to zero when n ^ oo. Suppose 
there exists a positive real constant u .such that bn ~ n~". Suppose there exists also a positive 
real constant b £ (—1,0) such that 

m\ « \9t 



(a) // there exist a £ (—1,0), e > and a positive real constant k such that 

9(0) 



< k, for all < 9 < e, 



then u > 1 + a. That is, the decreasing velocity of \bn\ is at least of order n when 
n oo. 
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(b) If there exist a G (—1,0) and a positive real constant v such that < vn (^+"), then 
b < a. That is, g{6) is at least of order of \6\"', when 9^0. 

Hence, from (a) and (b) above one concludes that u = 1 + 6. 

Remark A.l: In the general cases, we point out that there exist sequences {6n}neN (not 
monotonous) such that cin"" < < C2n~", for some positive constants ci and C2 and u such 
that < u < 1, but g{6) does not satisfy C3\9\'' < \g{9)\ < C4\9\'' for any fixed positive constants 
C3 , C4 and b. 

Theorem A.3 is a consequence of the following result. 

Theorem A.4 (Riesz): Suppose that g{9) = X^^i 6ncos(n0), for all 9 G {—tt,tt), and that 
{^n}neN € decreases monotonously to zero. Let p> 1 and q > 1 be such that p + ^ = 1- 

(a) IfgeCP, then Zn=iK\' <oo. 

(b) If En=i Ibnl" <oo, then ge CP. 

Remark A. 2: Theorem A.3 follows from Theorem A.4 making use of 

(a) for any continuous function /, on (0,7r), of order {x close to zero), then f e JC^ a > 
—1 and 

(b) for any sequence Cn of order n~/^ {n close to infinity) then J2'^=i |cn| < cxd <;=>/?> 1. 

Theorem A.4 follows easily from the first theorem of Chapter X, Section 9 of Bary (1964). 
The above results justify the ideas used in the estimation methods Perio, Parzen, Cos(l) 
and Cos{2), given in Section 4. 

Appendix B 

Considering the rate of convergence to zero of the autocorrelation function one can also get an 
estimate of the order of magnitude of the variance for the partial sums Sn = X^^g^ Xi from a 
time series • • • X__3, A_2 5 A_i, Aq, Xi, ■ ■ ■ , Ajv-i- In Proposition B.l below we present a proof 
of the estimated value for the variance of the random variable Sn. In Proposition B.2 we give 
a precise estimate of the order of growth for the variance of this random process. 
We point out that the stationary process stated above and given by 

At = (v9ori)(Ao), fortGN, 

can be considered defined for all i G Z, via the natural extension transformation (see section 
5.3 in Lopes and Lopes, 1998). 

Proposition B.l: Let {Xt}tez be any stationary stochastic process. Let Sn = X^^Lo^ X^ be the 
partial sum of a time series Xq,Xi, ■ ■ ■ , Ajv-i from this process. Then, 



1 Q 



2 N 



Var{SN) = 2N 

where 7x(") is the autocovariance function of the process {Xt}teZ- 
Proof: Since the process {Xt}t£Z is stationary, we observe that 
Var{SN) 



Var (E^^ 



N-l N-1N~1 

Var{Xi) + YY1 ^o^i^j'^i) 
1=0 j=o e=o 

NVar{Xo) + i^i^J^'^) " P(^o)]') 

j=0 i=0 
N-l 

Njx{0) + 2Ylx{j-i)- (B.l) 



3,1 = 



It follows from the expression (|B.ip that 

N-l 

Var{SN) = iV7x(0) + 2 ^7x(j 

J,i=0 

( 



iV7x(0) + 2 



7x(-l) + 7x(-2) + 7x(-3) + • • • + -ix{-N + 1) 



+ 7x(-l)+7x(-2) + ---+7x(l- (iV-1)) 

V ' 

+ 7^(-l)+7;^(-2) + -..+7x(2- (iV-1)) 

V ' 

+ 7x(-l) + 7x(-2) + • • • + 7x(3 - (A^ - 1)) + • • • + 7x(-l) 

^ V ' ^ V ' 

i=3 j=N-2 

= NjxiO) + 2[{N- l)7x(-l) + {N- 2)7x(-2) + {N - 3)7x(-3) 
+ • • • + 37x(-(A^ - 3)) + 27x(-(iV - 2)) + ^x{-{N - 1))] 

N~l N-l 

= Ar^^(0) + 2^(iV-j)7x(-j) =A^7x(0) + 2^(iV-j)7x(i). (B.2) 
j=i j=i 

The last equality ()B.2p follows from the fact that the process is stationary. This implies that 

7x(j) = 7x(-j)- 
Therefore, 

Af-l 

Var{SN) = Njx{0)+2j2iN -j)7x{j), 

i=i 



on 



and this completes the proof of Proposition B.l. □ 

In the next proposition we show the order of Var{Sj\[), with respect to A^, for a quite general 
class of stationary stochastic processes. 

Proposition B.2: Let {Xt}teZ be any stationary stochastic process. Let Sn = X^^^q^ Xi be 
the partial sum of a time series Xq, Xi, ■ ■ ■ ,Xn^i from the process {Xt}tez- If there exists 
u £ (0, 1) such that ^x{h) ^ then 

Var{SN) ~ iV^"". 

Proof: For u G (0, 1), the integral 



1= [ (l-x)x-"dx 



is finite. Then, for any A'^ € N, one can consider the Riemann sums associated to the partition 



1 2 N-l 



obtaining the approximation 



^\ N \ N N 



N 

,^ ~ N J \N J N' 
that converges to /, when — > oo. 

From similar arguments proposed in Lemma 8.1 of Fisher and Lopes (2001), consider 

N 

= E(i-i)(i 



N 

E 



NJ 
N-j\ ( 



N \N 



N / 1 \ l-u 



= E(^-^-)rM^) " . (B.3) 

i=i ^ ^ 

Given e > 0, for N sufficiently large, one has that 

I -£ <^CN <I + e. 
Using the expression (lR3l) . the ab ove inequality is given by 

1 ^ 

(J _ e) iVi-« < - Y,{N - j) j-^ <il + e) N^-\ (B.4) 
for N sufficiently large. 



01 



Therefore, 



1 



N 



Y^i^- j) is of order N 



l-u 



Prom the expressions (|B.2p and (|B.4p one has 



Var{SN) = 2N 



7x(0) , 1 



2 




—u 



and this completes the proof of Proposition B.2. 



□ 



The above results justify the ideas used in the estimation methods Varmp and Vpmp, given 
in Section 4. 
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